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ABSTRACT 

This report concerns the present status of the Kansas 
Right to Read plan of action. Two years of activities are 
discussed — the 1971 summer workshop, evaluation of the first year's 
program (1971-72), and the 1972 summer workshops. Thirty classroom 
teachers took part in the one week suaimer workshop in 1971. This 
rforkshop was designed by the State Reading Education Specialist and 
other educators to prepare teachers to return to their schools and 
establisl* inservice programs, A workshop content survey was given, 
and this data indicated a definito knowledge gain in selected 
workshop topics. The evaluation of the first year's program reports 
on the responses of the teachers in the 1971 suaimer workshop 
regarding their success in sharing their workshop experiences. The 
teachers indicated a statistically significant increase, at the .01 
level, in their over-all rat. ng of their school reading program's 
effectiveness. The final report, for the two 1972 summer workshops, 
includes an evaluation by the 60 parti :ipants based on daily 
sessions, evaluation checklists^ a pre-post workshop content survey, 
and a workshop summary. The overall evaluation score for both 
workshops was 9.7 on a 10-point scale. (WR) 
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?i^Oj?m: !iV/vLUATic:] - Fin^iT ^:u:2 imiCiiHO? su:':i:2r 1971 

mT2: AUGuS? 1^71 



Tliirtv clac.oi'ooi!! tcachcrn took part in a one week workshop de^ilinr^ 
vath rcadin-: and rcndinr-rolntcd topics. This vrorlcshop "i-ras desin:ned by 
the State P.cadin'". liducation ypecialist and other educators to prepare 
these teacliero to rotirrn to their indi\ddual buildin.^i;s and establish 
local inpci'^rico prc^i'aris. Tliis report covers only the ^uirmer V/orkr.hop 
acti\dtion, A later evaluation report v.dll be subnitted in the 
S\.ti:i:::er of 1972 to cover the total Pd rrht- to-Read Projioct. T!^e ruin>.ier 
T/orlc^hop iraE: highly succepc;ful and fjreatly valued ar iiidicated in the 
coiriTients and rer.ponncs of both the participants and the speakers. 
A vrorkshop content r.^'orvey, similar to a subject matter eraurdiiation, 
\.7is given and thdn data indicated a defi'iitG knovrled^^e ^Bxn in 
selected vx>rlc?hop topics. Kecomnendations, isuch as more demonstrations, 
Rore invo?.vcinent in learnlnf; process and additional tir^e to . concentrate 
on specific topics, vrere also j^iven. Tlie folloidnr^ cornT^ents made by 
the ;x>rkshor> mrticioants best. e:rpvess the real value of the workshop. 
**The Kansas Pdrrht-to-P^ead vroriCshoiD has given ne the spring-board I feel 
is necessr^v i^*! up-datinj^ omt reading pro -ran.*' - "I nust in nil 
sincerity coiifcss that I r-ained nore practical information 7?rorn this 
irorkshop than I rained in all ny educational ozjDeriences. *' 
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■ KAl-ISAS STATE RIGHT-TO-RKAD PROJECT 
mOTjPJS EYALUATIOH 



I IHrRODUCTIOIl 

The state Rir;ht-to-Head plan is desifrned to bring about measurable 
imDroYenents in the reading?; skills and attitude.-? of children in Kansas. 
Rese?.rch has indicated that the classroom teacher is the key to effective 
reading pro|:^rairiS« Consequently, the Kansas plan is teacher oriented in 
the for;:!! of inser-vdcfe vorkshoDS for classroom teachers* Further inforriation 
on the philosophy and total program is available in the K?nsas State 
Department of Skiucation booklet, K?in?as Rif^ht^ to- P-e.nd Pla.n * 



In brief, the basic plan consists of a series of summer workshops 
\Acre a selected group of classroom teachers are e^qijased to reading- 
related programs, sup:gestions and materials^ These summer vorkshop 
participants then return to their o\<t\ school districts and vork mth 
fellov; teachers in implementinp; these newlj'' acqiured skills, ideas and 
programs through local inservdce sessions. 

II P'ROGF;Ai^ EVALUATIOI^I DSSIGN 

The total evaluation will cover tvro aspects of the Kansas plan; 
first, the effects of the summer workshop and secondly, the' influences 
of the workshop participants once they have returned to their respectiv 
school district and have established their locally orgarJLzed inservice 
programs. This report vail present data on the summer workshop only* 
The final report, iThich vdll be available next summer, will present the 
evaluation of the loc&l inservice programs and the overall Right-to-Read 
plan. 

A series of surveys and questionnaires were developed to collect 
data on various aspects of the s\immer workshop. Ifost of the foms were 
designed to gain the TOrkshop participants reactions to the summer 
program. Additional evaluation sources were the •C'brkshop leaders and 
speakers. The participants supplied evaluation data through the follovdng 
sources: 

Pp-iliV Session Evaluation C?-)ecklist - A short form vAiich the 
participants completed at the end of each major phase of the workshop 
program. 

2. Worknho-Q _C pnten t Survey - This was a 1^ item survey which asked 

the participants to respond to specific questions related to content 

r4iich Was covered in the workshop presentations. The participants 

comoleted this sur\'ey tvdce: first on Sunday eveninc; before the first 
major workshop speaker and then again on Fiuday after the wrkshop ended. 
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To develop the auor/uions on this for.n, each of the workshop speaker.^ 
was contacted before ti^e vrorkshoD nrxd v:aG asked to raipp3.y the evaliuitor 
\-jith a short siJi^LTi^-^ry of his .lirosentation' s content. 

3« Ro,p:tn ,n:-: 'll^^Z^^j^ - Tliis forr^, collected basic information on the 
particii%nnts' b-^c-rirround, thcdr attitiidcs tov:rrd select reacUnf^-rel^^tcd 
variables and ciu^rc-nt practices in their schools' reading; prorrraris. 
They i-dll 'comoloto this same form acain ne>± soring to deteiTiine- if any 
chanr^es ha,ve taken _o].ace. This foim was also completed by the staff 
members, teachers and princinals of tho workshon participants* schools. 
Thecie same staff . :r;er:bc7\s vdll resnond to this fomn ner-rb sprinf? also, 
Thi.s data should indicate whether tiie sunner workshop participants 
brought ■ abovit i:V:Provonents in the schools* reading prorrrara as vievrod 
by their fellow teachers. 

^« >'fork. sl\o n ^hrr- prv I^'Jalurti on C^-'.ecklist - This fonn was desiprned 
to obtain the participant's reaction to the overall effectiveness of the 
workshop, the appropriateness of the workshop content and recoirjuendations 
for future workshops. 

Each workshop speaker evaluated his phase of the v:orkshop by 
completing the Ijorkshon Conr ra ltants Evaluation 'forjr:. 

Ill SUI'EiHH l-mK^llCP VALUATION 

Q^l[LQS22iiXsil-^ ££. '.•/orkshon Parti ci._n_a nts The first sa^iTier vrorkshon 
consisted of thiroty teachers ranging fron kindergarten to ■ eighth grade 
teaching positions. They also were representative of all sizes of school 
districts. 

^B. D^i^ .fro;n 'Workshop ^hini^-J^ SvpI-'A--^ tion - Twenty/- five of the thirty 
participants, 83;-, returned • thi s fonn. V^nen asked to rate the overall 
value of the vjorkshop^ on a 10 point scale; 1 for poor to 10 for otitstandinrr; 
the iTieaJi ratir.r^ vras 9 •35 T-ji:iich^ indicates an outstanding' rating. Six of the 
25 gave the vrarkshop a 10 which is the highest rating. 

Tne particdpajats vrere requested to react to each phase of the TOrkshop 
mth regard to fbui* factors: appropriateness of content to their school 
situation; present utilisation of content; anticipated difficulty in 
presentation of i^.if or/aation;- and a projection of *altinate -atilization of 
infonnation# Table 1 displays their responses tc these questions. 

^ Their responses indicate that they felt that more than half of the 
teachers they acquainted vTxth Beha^/ioral Ob.iectives, readinf^ diagnosis 
and individual! 2.atl on of reading TOuld utilize these aspects of the workshop. 
About one third of them thought they might have some problems in passing 
on the ideas rrelated to Behavioral Objectives o Other conclusions" can be 
dravrn froi^ further examination of Table 1. 
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Th'G folloirln-^ is a sfmnmnry of their rccoraiondntlons for chann;v.s 
in future P:irht-to-r<cnd worlcshopoJ 

• !• li)re dcraonr^trationr; and involve parti ci pa; '*s in ,- 

lep.rnrln;;:: jatuation. ' 8 

2. Don't ir^chcdulo evening meetinniv^, allots time for; 

"rappinr-/^ exchanrvo of ideas, talk inforjiall?,^ : ' • 

irith conrroltanbs, .just relax, etc. '/8 

3. « Covcroil too much, noved too fast, need more time . j 

to ^r»::HV*.rcrato on specific subjects. 5 

4. lie c\.;?".rC"Ooni visitation sucli as. this year. 4 
5t i'pcr.V::.-.- ri-jld hand out n-ore mterial* . " 3 
6. 'xyr:'l i the Sunday ^^^^it films* 3" 

Tlic - ic :■ ;yants also gave su:-:,^cstions for topics if they were 
. ' c be involved in a follov:-up necting to the summer workshop. They 
reco:ri)7iended: 

1. i'iore on individualizing instrruction. 11 

2. More on diagnosing students needs and pre- 
scribing pzx)f;ra:ns based on these needs. 10 

3» i'bro on behavioral Objectives. 6 
A ti^ne for sharinj?;- of ideas on various aspects 
of the teaching of reading. 6 

5» A tine for discussing the acceptance and imple- 
mentation of their local Right-to-Read pro[;rans. 5 

They were also rcx3uestGd to indicate which two of the workshop 
consultants they would like to spend more time Tvdth. Dr. Wa'tson and 
Dr. Bro^m were selected by more than 80 per cent of the participants. 
Five; indicated more tine vTith the State Department team on Behavioral 
Objectives and four idth Shackleford. 

Additional co-a^.cnts by the pai'ticipants indicated the* great 
benefits of such a workshop. A couple of t^rpical comments were s 

"The live-in situation \7as one of the best things about the 
T-Jorkshop. " * * . 

"I thought thei'.-orkshop was great. The enthusiasm of this group 
of people mil certainly help to improve the instruction of reading." 

C» JS^^ fr^c:n D^il-^r Woykshoo S ession Svalu^ition - After each 
major section of the workshop the participants completed a short form 
expressing their immediate reaction to that session's topic and content. 
On this form they irere asked to rate the value of the session on a 10 
point scale, 1 for poor to 10 for outstandings Other questions vrere 
asked dealing idth appropriateness of topic, i-jhether topic should be 
in future vrarkshops and the need for more information of the topic. 
Table 2 displa^rs a summarj'* of the data from this source. 
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The Pcirticinants ir.niediatc reaction to the TOrlcshop topics 
indicate tho.t all r.essions v:cre rated above avera;::e* The presentationrj 
on neusi5Anerr» in tho readin': pror-rarn ?nd the idccnr. u^ed in the reported 
Title III project- vjcrc the Uir:i"ier/fc rated, i-'ost parti cipantr*. felt that 
the toiDic.*:: o:r indi'^/j.dunlir.cd readin-, rer.dinT: dia^:nords, nev^r.oaPcr 
utilir.ation, ai^.d bchr.\'ioral obiectivos vrere dofiiiitcly appropriate to 
their school ratuation. All of the participants felt all the session 
exx^ept ET/ and the school/librr^r;/ ^ri.sitation should be repeated in 
future worlrshops* Vioz\t of the participants indicated more infor:nation 
on the topicr» vrovld be valuable. This data tends to support the 
same evalf-atioh e:q:^ressad in the VJ orlrshon .',i:h;:-^-:^ry fornzs, 

- 0* ILopvO-tj^^on?' b^?; V.V:-':snor) ^^epJcQXS - All of the consultarits 
indicated the irorh-shop participants "^rorcvery responsive and interested 
in their tonics,' All but one irere satisfied vath their presentation. 
The najor concern iras that more time should be fd.ven. so that the 
consultant could interact mth the participants more. Host of the 
coiisuD.tants i::ade- additional co:?j?.cntG v/nich indicated 'enthusiasm and 
the value of vrorhshops of this t:,a)e, and hou vr^ll organised the total 
x^orkshpp vjas, ^'^evei\al felt there \7as a need for a follo^:-up meeting 
later in the year mth the same pax^tieipants. 

Unia i^QI:l lJox^!irjl9Il pQnter.t iluT^vev - This survey, was d':;id::;ned 
to collect infor:.iation of the participants fa^dliarity irith. concepts 
presented in the i.-orksliop. The suj^vcy i-.'as adven both befoi^e and after 
the' workshop so that it covJd be doten^iined if- a "chan-^re in their -^"^ 
response vrou.ld ta'ce place,. Each particip.ant *s pre and post TxorJcshpp 
surveyr. vrere chcclred individually to deiemine if their quality and 
quantity of responses chanr^ed. 

The parti cj.pant^s pre-v;orl:shop sur\'^eys exliibited a hip;h degree 
of uncex»tainty in their an s>rors and a lar5;e number of unansTrered 
questions. In face, out of a possible ^^20 questions, (I'l- questions . 
per survey ti:nes 3^ participants) 193 questions were left 'unansvrered, 
or abovit k6 per cent of the total nunber of questions. Many of tho 
other ansxvcrs irore ver?,'' short and limitedc The participants, on ■ 
the pre-siir^/eysj indicated very little Icnoic^ledge of those questions- 
dealinr^ vdth behavioral ob.jectives, use of typevTriter^in reading 
pror^rans, helpinr: the uninvolved student, behavioral nodifi cation 
techniques in reading pro^-rains, and^hou the newspaper can best 
be used in the readinr^ program. 

»■ 

The particinants post-workshop surveys showed a higher degree 
of consistency in their responses as a ^;roup, Individuall;^ their 
ansrrers were more co;::nlete, conple>:'andhcnowledn;eable. Also it is 
interostinr; to note that onJ.y 2 questions -jere left unanswered, . 
i-fnich represents less than of one percent, Thds survey indicates 
that tho pai^ticipants laado- definite grains .in their knov7ledr;e of the 
vrorkshop content, - ' . 



IV SUl-IrlAFlY Alii) OOliCi.USICiyfl C:! TiiE SUI'VllS V/ORKSHOP " 

In both cenerpJ. anc3 r.pccio'ic p.rer.s the Tsorkj^^hot) vjps a success. 
Both t'r*e parti ci^\''.n*:;, nn.-] the npeakei\^ e:cDrGSf^ed a. hir^h derreciof 

satii^ifaction "idtl-i o/iO vorknhoo, 'ihie value of the e:n:>Grience kAsl 

denonritrated -'ii tho mrtici'^nnts' enthusiasm for the overall vrorksLiop 
and t-'icir coiTricntc; on snocific- tordco. They feD.t the ivorkshou phaber:; 
on indavldu.nli:dn'; roacan.;\ car^fTjosls cond prescribing' for readi^^p^ . 
disabiliticr; and beViavdoi^al objectives concepts vrere very valiiabi*il 
'^^<^ ''.^d^'CQIl l<Prj^ sho-.Ted a definite increase in 

the participaiitc Icno^.jlod^e of selected aspects of the workshop' 
content, The daily and su:':mr//. evaluation for^ris supported one another 
in the conclusions of value and appropriateness of the vrorkshop 
phasfu^ cited above, • • . 

The consultants and T>articir)ants made several recommendations 
foi" futi^jre Kir^ht-to-P-ead ^.rorlcshops. The nuinber of participants was 
food, but ',i;ore .ti:7io should be -riven to specific topics so tliat doinon- 
strations can be held and. the participants can become more involved 
in the Icari'iin^ process, Evemn^ viii^ht be left open-ended so' the 
individ.uals could discuss and share ideas, rela:;c and go over the 
day's notes, neet iiif or.io.lly "^ath consultants, etc. 

The follovrln^^ cov.ii-iTents by sone of the participants can be^t 
e:g)ress the true evaluation of the vA^rkshop e:cperienccs: >^ 

thdnl: tbds vrorkshop has really been a turiiinr^; point 
in Tiiy teaching career, I believe that sta;^rin:^ here and 
associa.tin.r vith each other and *^breald.ng dovrn the barrier,'' 
has been the best part about it because our feelings as a 
group totrard our oblif;ations is goinr: to really doterjiine 
hoir successf'ol the Horkshop irill be. V/e have achieved this 
feelin:"]; through, the atr.iosphere created here." 

^'Hir';h on the list of strenf;ths . -vould be the "Kui^ian - 
■ 3le:nent.** j3veiTv''one has been so fi^endly, etc. and after all 
. isn't that ^^\'hv.t it's all aboutT'- We \toTTy so. nuch about 
criilda^en's. self-i]r;iar^es but in this case I feel thds Korksh.op 
has irox'ked -.renders for many of the participants self-images 1*' 

*'Tlie Kansas Riniht-to-P-ead vrorkshop has (vLven me the 
sprinr^ board I feel is necessary in up-dating our roadinn; 
proj^rain. The subjects discussed^and ouestions answered are 
e:cactly the t^^je of inforpiation I've (we've) been needing. 
I'm really fri?^htened and challenn;ed. as to the vastness of 
"isiiat can be done - and hope to inject this into m:^ oirn vrorkshop 
so that no .teacher can remain passive and unaffected," 



"Plrr.t and foTor^.ov^t - I feel thnt the r;rouo iras r?.ntA?tTc« 
I^evcr before l:p.ve I been a part of a prouu irio i.-as vdllin.'^ 
to r/:ir.re and no mch fun to bo a part of. The r:roi:o vns so 
varied - all a'rerj, al3- partr. of the Gtato, varied leaching; 
experiences and a varied educational back^^round. I nust in 
all sincerity eonfor.s that I (gained more practical inforr.Tttion 
from thir^ yov'.ztiho'o than I have gained in all r\v educational 
e:jrperiencer>. 



'•A vcr;^r bif; "thanks'* roes to all ".mo made this possible. '* 
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KANSAS RIGHT-TO-READ PROJECT 

PROGRAM EVALUATION - FIRST YEAR'S PROGRAM 1971-72 
• REPORT SUBMITTED TO WESLEY PELSUE, STATE READING EDUCATION SPECIALIST- 
EVALUATION DESIGNED AND REPORTED BY DON D. SHIRLEY 
DATE: SEPTEMBER 1972 



Thirty classroom teachers took part in a ^^fe week workshop dealing 
with reading and reading-related topics. This WeVkshop was designed by 
the State Reading Education Specialist and other educators to prepare 
these teachers to return td their individual buildings and establish 
local inservice programs. The summer workshop was highly successful, 
and greatly valued as indicated in the comments and responses of botti 
the participants and speakers. The responses collected from teachers 
in the schools v/here participants shared their workshop experiences 
indicated a statistically significant increase, at the .01 level, in 
their over-all rating of their school's reading program's effectiveness. 
The participants felt there was a definite movement towards individualizing 
reading instruction in their schools. As a result of the program , 
5 schools received special reading-related federal grants, many schools 
increased the variety of their reading materials and equipment, one 
school added a librarian and media center, and schools made a greater 
use of inservice programs in relation to the teaching of reading. 
The greatest- two impacts of the program were that it has made teachers 
more aware of their teaching of reading techniques and that it. has 
directly influenced the v/ay the workshop participants think and act 
with regard to the various aspects and techniques they themselves use 
with their own students in teaching reading. 



'KANSAS RIGHT-TO-READ PROJECT 
PROGRAM EVALUATION 
. 1971 - 1972 



Report submitted to: 

Wesley Pelsue, Reading Education Specialist, 
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KANSAS STATE RIGHT-TO-READ PROJECT 
PROGRAI-1 EVALUATION 



I INTRODUCTION 

The state Right-to-Read plan is designed, to bring about measurable • 
improvements in. the reading skills and attitudes of children in Kansas, 
Research has indicated that the cl assroom teacher is the key to^effectlve 
reading programs. Consequently , the Kansas plan is teacher oriented in 
the form of inservice workshops for classroom teachers. Further 
information on the plH'l^osophy and total program is available in the- 
Kansas State Department of Education booklet, Kansas Right- to-Read Plan , 

^ ■ ■ 

In brief, the basic plan consists of a series of sumumer v/orkshops 
where a selected group of classroom teachers are exposed to reading- 
related programs^ suggestions and materials. These summer workshop 
participants then return to their own school districts and work with 
fellow teachersin implementing these newly acquired skills, ideas and 
programs through local inservice sessions. 

II EVALUATION DESIGN AND PROCEDURES 

The total eval uation covers two aspects of the Kansas plan; first, 
the effects' of the summer workshop and secondly, the influences of the 
v/orkshop participants in their own schools after they have shared 
their workshop experiences for a year with their fellow teachers. 

' The first part of the evaluation, dealing with the summer workshop, 
was completed last summer and a copy of that report, is in Appendix A. 

The second phase of the program design is in relation to the effect • 
of the workshop participants on their school's reading-program. Pri- 
marily two methods were developed to collect this data. The first 
method was a reading survey which the teachers in the workshop 
participant's schools completed before the program started. May 1971, 
and again after the first year of the program. May 1972. This survey 
collected baslr; information on the teachers opinions and attitudes 
toward selected reading-related variables and current practices in 
their school's reading program. This data indicates whether the summer 
workshop participants brought about improvements in their school's 
program as viewed by their fellow teachers. 

The second method for'data collection on the over-all effective- 
ness of the program was by a narrative report received from the workshop 
participants after the year was over. Each participant was asked to 
respond to the question: "How has the Right-to-Read workshop effected 
■ your school during the 1971-72 school year?". 

A third source' -of data developed in the course of the year. The 
partici.pants started a newsletter. The Nitty Sritty Nev/sletter . Some 
comments were taken from this publication to show some of the activities 
started in the schools. 

O ' ■ 
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III RESULTS • 
A. Reading Survey 

The Reading Survey was sent to all of the participants' schools 
both before and after the program. Twenty-five schools out of thirty 
returned the surveys berfore the Right-to-Read program began.. For the post- 
assessment period 26 schools returned the surveys. It was determined 
though, that four of the schools returning forms at the end of thj year 
had not sent in forms at the beginning of the year. In order to make valid 
comparison on the survey, only those schools returning bouh pre and post 
period forms .v/ere analyzed. On^the pre-v/orkshop survey, 249 teachers 
returned the forms ^ while for the post-workshop survey 219 teachers 
returned the forms. To improve the efficiency of the analysis procedure 
whenever percentages were used, due to the difference between 2^t9 
tdachers and 219 teachers, an adjusted percentage was used for the 
post-workshop survey responses. No adjustment factor v.as used in 
computing the t value for the comparison of the teacher's over-all 
evaluation between pre and post workshop survey. 

Before the first Right-to-Read workshop participants returned to 
their buildings, only 37% of the teachers were familiar with the 
Right-to-Read program. By the end of the first year after the workshop, 
88% knew of the Right-to-Resd program. 

On the pre-measure of the Reading Survey, ^1% of the teache>^s 
knew of behavioral objectives. When asked about behavioral objectives 
at the end of the year, 90% were familiar with this concept. Before 
the Right-to-Read program the, teachers had learned about behavioral 
objectives from magazines (22%) or. college courses (49%) and only 
4% had learned about them from other teachers. By the end of the year., 
the greatest source for knowledge of behavioral objectives v;as fellow 
teachers (67%), probably Right-to-Read participants. This increased 
knowledge of behavioral objectives generated a. greater use of behavioral 
objectives by the teachers in their reading programs, as indicated on 
the survey. Before the Right-to-Read program only 28% of the teachers 
used behavioral ' objectives v;eekly or daily, while after the participants year 
in the schools, 38% of the teachers said they were using them this 
frequently. 

As can be seen. in Table 1, only the frequency of use of behavioral 
objectives has increased to any great amount. The use of newspapers 
is very slight, from 35% to 40%. The other activities do not how any ■ 
re'Sil shifts in us^ge. 

Table 2 indicates there was a slight decrease in group-^ng students for 
reading instruction and whole class instruction and an increase in 
individualized instruction. 
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TABLE 1 

COMPARISON ON USAGE OFREADrNG RELATED ACTIVITIES 
PRE-POST PROGRAM PARTICIPATION 
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TABLE Z 

COMPARISON OF READING PROGRAM .ORGANIZATION 
PRE-POST PROGRAM PARTICIPATION 



Organization activity 


Pre , 


Post- 


KSacnng insciucLions given lo wnoie ciabs 
at the s^aiiie time 


m. 


■ ; 36% 


Grouping of students by achievement 


68% 


60% 


Grouping of students by common interests 


12% 


10% 


Individualized instruction 


54% 


57% 


Cross-grade level grouping 
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10% 


Basal reading textbook 
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40% 


Basal reader and supplementary readers 


66% 


60% 


Non-basal reader .approach 




31% 


Reading instruction given in content-subject areas 
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10% 


Others - 


8% 
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TABLE 3 

COMPARISON OF FORMS OF STUDENT EVALUATION 
PRE-POST PROGRAM PARTICIPATION 



Form of Evaluation 


Pre 


Post 


Commercially produced standardized achievement- tests 


67% 


56% 


Commercially produced standardized diagnostic tests 


46% 


44% 


Informal reading inventories 


. 39% 


42% 


Basal reader textbook tests 


54% 


53% 


Teacher-rmade tests 


62% 


61% 


Other 


10% 


• 12% 



% Indicate Frecuency of Response by Teachers 



There was also a slight movement away from the basal textbook 
reading approach and towards utilization of a greater variety of 
reading material. Before the Right-to-Read program, .48% v;ere using a 
basal -reader approach, after the participants worked a year only 40% 
of the teachers were using basal readers. Individualized instructional 
programs increased from 27% to 31%. Neither of these changes were 
significant. 

As shov/n in Table 3, the teachers indicated they moved away from 
using commercially produced standardized tests and towards more use 
of informal reading inventories. 

The data from the semantic; differential scale shows that for 
the average students, the teachers felt their reading programs have 
become a little more adequate^ 46% pre-workshop and 53% after. They 
also felt this program is a little more fun for the students, from 55% 
to 61%, Again, these are not what yo': can really call significant 
differences. ■ * . - 

On the question dealing with their reading program for the below 
average students, the differences were somewhat greater. After a year 
of the Right-to-Read workshop participants working in the. district, 
the number of teachers indicating the appropriateness of the program 
increased from 39% to 54%, They also felt this program was more fun 
for the students (36% to 44%), more meaningful increased from 43% to 
53% and more adequate (29% to 43%y for the below average students. 

For the above average students reading program, they, felt these same 
four .factors increased, as in. the ase of the below average student* 
Their program became. more fun (45% to 58%), more meaningful (54% to 61%), 
more appropriate (45% to 57%) and more adequate .(33% to 45%). 

When asked about their practices of diagnosing students' reading 
problems , they indicated their techni^Mes became'more appropriate, 
(44% to 53% of the teachers respondec and more adequate, only 25% 
of the teachers felt these techniques were adequate before the Right-to- 
Read workshop and 41% of the teachers felt it was more adequate after 
having the Right-to-Read participant in their building shariiig ideas 
for a year. . . 

All of the teachers completing the survey were asked to rate the 
over-all effectiveness of their schooVs reading program. The scale was 
a IC to 1 value; 10 for outstanding, 1 for poor. Table 4 displays the 
percentages of teacher rating their program at each of the value levels. 
The mean rating for the pre-workshop situation was 6.38 and the mean 
rating for post workshop was 7.01. When the data is treated with 
Fisher's t test for significant difference, it is found that this does 
re^present a significant increase at the ,01 level of significance, 
Ihe computed t value was 4,415. As can be seen, three times as many 
teachers rated their reading program a 9 outstanding, after the :'ear 
of Riqht-to-Read workshop ideas in their districts as before. Almost 
half 1^7%) of the teachers gave it an 8 or greater after the year, .as 
compared to less than one third (29%) before the workshop. 
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Two comments from teachers, not v/orkshop participants, further show 
the effect of the Right-to-Read program: \ ; 

"We have concentrated alot of time, effort, inservice 
training programs, money on up-grading our reading program." 

"The faculty is working very hard to teach everyone / 
to read- They are grouping the students to ability and are 
turning more to an individualized orogram each year. Thanks 
for the help from the Right-to-Read program." 

B. Narrative Report by Workshop Participants 

Each participant was asked at the end of the school year after 
their, summer workshop to respond to the' question, "How has the Right- 
to-Read workshop affected your school during the 1971-72 school year?". 
Twenty of the thirty workshop participants responded to this question. 

Only two participants responded with negative comments. Both 
participants indicated they didnot have the opportunity to share 
their ideas much with other staff c^members in the district. One of these 
teachers suggested that maybe it would be more helpful for participants 
to come from small school districts and those without special reading 
teachers. 

The most frequently mentioned affect on the school v/as. in the area 
of individualizing reading instruction (13 districts). In this same 
concept, 12 districts indicated a greater use of diagnostic tests and 
the use of pre and post testing to determine student progress. Also 5 
districts specifically mentioned the use of prescriptive teaching 
techniques in their reading programs.- 

Five schools indicated they are or will be receiving additional 
federal funds; Title II Right-to-Read or N-D.E.A.*, to help improve 
their reading programs. 

Improved and increased use of the school's library, was mentioned 
by seven schools. One stated that as a direct result of the Right-to- 
Read workshop they had organized a media center in their building for 
the first time and had hired a full time librarian. Another said they 
had made plans to start a library in their building next year. 

Many indicated a wider and more varied use of reading material 
and equipment. The following are some of the specific materials and 
their frequency: * , 

A. Newspapers - 3 schools 

B. Reading machines - 4 schools 

C. Magazines - 2 schools 

D. Reading skills file - 3 school'^ 

E. Typewriters r 3 schools 



Four schools v/ere moving away from a single textbook approach to a 
multiple material approach to the teaching of reading. 

Several participants (6) stated their schools had incorporated 
more fun and creative type teaching techniques and materials into their 
reading programs. They felt this resulted in the student having a 
more positive self-image or concept. The students v/ere also showing 
more interest in reading. 

A number of other activities were mentioned as a result of 
involvement in the Right-to-Read program: 

A. Interschool visitations encouraged . 

B. Development of volunteer programs 

C. Development of pre-school reading . 
readiness programs - 

D. P,.T.A. informed of reading programs 
and techniques 

E. Behavioral objectives developed and 
used by schools 

F. Promoted membership and interest in 

. the International Reading Association 

The value of inservice programs and workshop for classroom teachers 
was often mentioned by the participants. The following comment taken 
from one of the narrative reports shov/s this trend: 

"I think tne most important thing that Right-to-Read . 
has done to help my school is that the administration and teachers 
have realized the value of inservice training of teachers. 
Because of the favorable response to the workshop we have had 
this yenr, the board has allotted time and money for teacher 
training next year." 

Eighteen of the twenty participants responding indicated either 
they felt they had become a better teacher of reading or that they 
felt their fellow teachers had become more aware of the reading process, 
technique for teaching reading and the student's needs and abilities 
related to reading skills and interests. Several comments from the 
teachers best illustrate this: 

"I have been a better teacher this year because of Right-to- 
Read and therefore, the children in my room have benefited because 
of Right-to-Read./' 

"I do know that the Right-to-Read workshop changed my approach 
and attitude in the teaching of reading. I became much more 
conscious of individual needs and I worked hard to see that each 
' of my children had my assistance each day*.," 



"The first and most exciting, to me, was the concern shown by 
the classroom teachers. We were helped out of our ruts." - 
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"Plans are being made for a weekly teachers' meeting, in each 
building to discuss problems, ideas or recommendations. " 

"The methods, enthusiasm, and interest I acquired from this 
program has stimulated niy reading program and I am certain I 
' have reached more children due to this attitude*" 

"Perhaps one of the most important changes is that it has made 
teachers more av/are of reading problems. The teachers seem more 
interested in the individual instruction of the child. . The in- 
dividual has become the focus instead of the group." 

"It has made our teachers more aware of the great importance 
of their job as teachers of reading. They have become aware 
that it is the teacher who makes the difference." 

C* Newsletter 

The workshop participants formed a Kansas Right-to-Read Council 
and 'Started publishing a newsletter entitled, The Nitty Gritty Newsletter . 
They published five- issues between September 1971 and June 1972. It 
was developed so the participants could exchange ideas and keep 'each 
other informed on activities they were involved in. 

Many of the things mentioned in the newsletter were repeats of 
what they summarized in their end-of-year narrative. Inservice activities 
of some nature were mentioned almost every time. Nine times specific 
references were made to individualization of reading programs. All 
indicated they were either using new and different material or developing 
skill files to be made available to all teachers. Testing information 
was imentioned in 6 letters. Libraries were mentioned 5 times. 

They also indicated several activities related to professional 
self 'improvement. Four times books were suggested for professional 
reading. One letter told of the establishment of an International 
Reading Association chapter, one participant stated she was going to 
start graduate work in the teaching of reading, and several mentioned, 
visitations, workshops, conferences and college courses they were or 
planned to be involved in. ... 



IV CONCLUSIONS 

There is no doubt that the affects of the Kansas Right-to-Read 
program have resulted in some changes in some aspects of reading programs 
in se-'/eral schools in the state of Kansas. Only in one case does 
'hard' statistical data show this change in the program. There are 
many instances of changes in the programs cited in^ the Reading Surveys, 
the narrative reports and a summary of comments appearing in the 
Right"tO"Read newsletter. Most of these changes will resiflt in 
an improvement in the schools' reading programs. 
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The summer workshop v/as rated by its participants as a highly 
valuable experience. Many new reading skills were acquired by the 
participants. ; 

Data from the Reading Surveys completed by the teachers did seem 
to indicate that the reading programs for the above average and below 
average students improved more than for the average student. They also 
indicated a slight movement away from grouping or whole class presen- 
tation for reading instruction to some form of individualized instruction using 
a greater variety of material and equipment. 

Many things ,have been done to improve the reading programs in the 
participants' schools that are a direct result of the Right-to-Read 
program. At least five schools have received direct financial aid 
through Federal funds. New reading material and equipment has been 
purchased by some of the districts that might not have been otherwise. 

The two aspects that will probably have the greatest impact on 
improvement of the students' reading skills are the most difficult to 
measure. These effects are the improvement in the individual v/orkshop 
participantsV teaching ability and the increase awareness of other 
teachers as to their role in the teaching of reading. As most research ■ 
studies have shown the real key in any program is the classroom teacher. 
Both of these aspects have far reaching and long range effects cii their 
teaching of reading. These influences can best be summed up in tv:o 
comments taken from the workshop participants narratives: 

"It seems that what Right-to-Read had done for our school is 
still happening, because the greatest thing it has done was to 
awaken us, the teachers, to the fact that we can keep better 
records, change behaviors, try different things (whatever vyorks . 
means success), and botter prepare ourselves to meet individual 
needs. So Right-to-Read gave the push, but the Special Reading 
Teacher, Librarian, Classroom Teachers, and Administrators have 
kept the importance of reading alive. Our thanks to Right-to- 
Read for . the push. " 

"My biggest reward came v^hen a ''non-reader" said to me, 
"You know, you were right. Reading is fun*,"- 
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Two separate workshops were held for selected classroom teachers. 
The objectives of these workshops v/ere to .'provide them with new reading 
related concepts, techniques and materials so that they could return 
to their own schools and share this knowledge and attitudes with other 
teachers in their building. A total of 60 teachers participated in 
the two v;orkshops. The workshops were evaluated by the participants 
through Daily Sessions Evaluation Checklist, a pre-post Viorkshop 
Content Survey^ and a Workshop Summary. All of ^the sessions were 
rated as good to outstanding, except for a morning session on Behavioral 
■Objectives* The average over-all evaluation score for both workshops 
was 'the,same, 9.7 on a 10 point scale, outstanding. The responses on 
pre-post V/orkshop Content Survey indicated that the teachers gained 
knowledge of select aspects of reading techniques and concepts. 
Comments in the daily, and the over-all evaluation by the participants 
indicated a' high degree of satisfaction with the v/orkshop and felt it 
to be a valuable part of their professional growth in the teaching of 
reading skills. 
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KANSAS STATE RIGHT-TO-READ PROJECT 
PROGRAM EVALUATION 



I INTRODUCTION 

The state Right-to-Read plan is designed to bring about measurable 
improvements in the reading skills and attitudes of children in Kansas. 
Research has indicated that the classroom teacher is the key to effective 
reading programs. Consequently, the Kansas plan is teacher oriented in 
the form of inservice v/orkshops for classroom teachers. Further 
information on the philosophy and total program is available in the 
Kansas State Department of Education booklet, Kansas - Right -to- Read Plan . 



- In brief, thebasic plan consists of a series of surmer workshops 
where a selected group of classroom teachers are exposed to reading- 
related programs, suggestions and materials. These- summer workshop 
participants then return to their own school districts and work with 
fellow teachers in implementing these newly acquired skills, ideas and 
programs through local inservice sessions. 

II PROGRAM EVALUATION DESIGN 

The total evaluation will cover two aspects of the Kansas plan; 
first, the effects of the summer workshop and secondly, the influences 
of the v/orkshop participants once they have returned to their respective 
school district and have established their locally organized inservice 
programs. This report will present data on the summer workshop only. 
The final report, which will be available next summer, will present the 
evaluation of the local inservice programs and the over-all Right-to- 
Read plan. 

A series of surveys and questionnaires were developed to collect 
data on various aspects of the summer workshop. Most of the forms 
were designed to gain the workshop participants reactions to the 
suimary program. The participants supplied evaluation data through 
the following sources: 

1 . Daily Session Evaluation Checklist - A short form which the 
participants completed at the end of each major phase of the workshop 
program. 

2. Workshop Content Survey - This was a 14 item survey, 12 items 
in the latest edition, v/hich asked the participants to respond to 
specific questions related to content which was covered in the workshop 
presentations* The participants completed this survey twice; first on 
Sunday evening before the first major workshop speaker and then again on 
Friday after the workshop ended. A new content survey was developed 
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for the second workshop session this summer. Some of the topics and 
major points of the workshop speakers had changed from the survey used 
for the summer of 1971 v/orkshops. To develop the questions on this form, • 
each of the workshop speaker^s was contacted before the workshop and 
was asked to supply the evaluator with a short summary of his presen- 
tations content. 

* 3. Workshop Summary - Each participant v/as asked to rate the • ; 
over-all workshop on the 1 to 10 scale. They were also requested to / 
make any comments or recommendations on the total workshop oh this 
form. * * 

III RESULTS 

A. Data from Daily Workshop Session Evaluation - After each 
najor session of the workshop participants completed a short form 
expressing their immediate reaction to that session's topic and content. 
On this form they v/ere asked to-^rate the value of the session on a 10 
point scale, 1 for poor to 10 for outstanding. Other questions were 
asked dealing with appropriateness of topic, v/hether topic should, be 
in future workshops and the need for more information of the topic. 
Table 1 and 2 display a summary of the data from this source. 

All of the sessicis in both workshops were rated from good to outstanding 
except for the Behavioral Objectives sessions. Both workshop participants 
marked these below average. They indicated some question as to the 
appropriateness of this topic and questioned whether it should be in 
future workshops. The Behavioral Objectives presentations seemed to be 
too formal J dry and often too technical. It was suggested a number of 
times from both workshop participants that maybe the Behavioral Objectives 
topic should be presented earlier in the week and be presented in such 
a style to allow more participant interaction with the subject. 

The other daily presentations were rated quite high^ particularly 
the perceptual aspects of reading disabilities and use of newspapers 
in the classroom. All of the rates were higher in the second workshop 
than in the first. 

Data from Workshop Content Survey - This survey v/as designed to 
collect information of the participants familiarity with concepts 
presented in the workshop. The survey was given both before and after 
the workshop. so that it could be determined if a change in their response 
would take place. Each participant's pre and post workshop surveys were 
checked individually to determine if their quality and quantity of 
responses changed. 

. The survey used for the oune workshop was the same one used for the 
workshop during the summer of 1971. It was found to be inadequate 
because some of the topics changed and some concepts presented by the 
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speakers changed. Three of the questions, 2 on educational TV and one 
on librray, v/ere.not counted in the analysis because they were not 
part of this summer's presentations. The content survey was revised 
for the second workshop. 

On the first workshop pre-workshop survey, '30% of the questions 
were left unanswered. Many others were only partially answered or 
answered with incofiiplete thoughts. -On the post-workshop surveys for ' • 
this session, the percent of unanswered questions dropped to 

! 

The second workshop pre-assessment survey showed that 45% of the 
questions were unanswered. On the post-workshop surveys only 5% of 
the items were unanswered. 

The participants post-assessment surveys for both workshops showed a 
higher degree'of consistency in their responses. Their answers wer;e more 
complete, and exhibited a higher degree of understanding of the concepts 
presented during the workshop. Both workshop participants still showed 
problems dealing with the question on criteria reference tests. The 
teachers in the second workshop also showed some confusion • between the 
Mills Learning Test and the Fountain Valley Support System. 

In general, the post-workshop surveys did indicate that the 
participants made rather significant gains in the familiarity with the 
concepts presented during the workshop. 

C. Over-all Workshop Evalu ation.- The over-all "workshop. eval uation 
by the participants indicated that the workshop time was very valuable. 
The average for both workshops was the same rating; 9.7, outstanding. 
This rating is higher than the one given the first Right-to-Read workshop 
in the summer of 1971. 

. All but four of the participants in both workshops indicated that 
it was a tremendous learning experience. Many said it was the best 
single educational experience they have ever had. Many of them also 
commented on the fine leadership from Wes Pelsue and Gene Schulze. 

-Tha only specific recommended change mentioned* several times 
was that the Behavioral Objectives presentation be changed and moved 
to early in the week, Monday. Other recommended changes included: 

K More sharing of ideas and materials 

2. Have speakers go out into the schools to help them during 
the year 

3, Open workshop to more than 30 at a time 

4- The speaker might have more material to hand out 
5. Make some sessions more group interaction oriented • 
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'6. Use students in demonstrations 

7. Have a panel on individualized instruction 

8. Lonqer noon hour breaks 

9. Call workshops seminars so -they can be counted as 
college credits 

10. Have Gene Schulze make more presentations ^ - 

IV- CONCLUSIONS 

Both workshops were definitely of benefit to their participants. 
Comments in the daily and the over-all evaluation by the participants 
indicated a high degree of satisfaction with the workshop and felt 
them to be a very valuable part of the professional grov/th particularly 
in dealing with reading. The Workshop Content Surveys responses showed 
a definite increase in the participants knowledge of selected aspects of 
the -workshop content. 

The participants did not make as many specific requests for changes 
in the workshop as they did last summer. The only major recommendation 
was to. change the Behavioral Objectives presentation and move it. to a 
spot earlier in the week- 

The participants enthusiasm towards the workshop experience can 
best be expressed by some of the participants comments: 

"It has been one of the most exciting and inspirational - learning 
experiences I have had since I started teaching. We need more of 
this type- of learning for teachers - something relevant to our real 
problems - and with suggestions for their solution," 

"I'll never be the same again. It was a great experience," 

"I wish every teacher in Kansas could have this opportunity." 

"I feel this v;orkshop has been a turning point in my teaching 
career," 

"The Kansas. Right-to-Read Program has been a tremendous event 
in my professional life. I have obtained a great deal of valuable 
knowledge. It has kindled a flame which had started to flicker 
out but being here with other people who really care about the 
students has prevented that tragic event from happening. 



